Electronic information content distribution processing system, information distribution apparatus, information processing apparatus, and electronic information content distribution processing method

ABSTRACT

A system is provided to distribute electronic information contents D 0  containing advertisement to a user, and process advertisement information D 2  at the user side. This system comprises an information distribution apparatus  19  for distributing advertisement information D 2  to the user; and a plurality of information processing apparatuses  8  for receiving and storing the electronic information contents D 0  distributed from the information distribution apparatus  19 , reading out the electronic information contents D 0  according to the user operation, and processing the electronic information contents D 2 , thereby outputting the advertisement video image and its audio. With this configuration, after receipt of advertisement information, the user can see and hear an advertisement video image or audio freely processed with respect to an advertisement by the information processing apparatuses  8  in unreal time (asynchronously) like playing a game. In this manner, there can be constructed a electronic advertisement medium which reverses a concept of an advertisement of big four mass media, the advertisement having been supplied one-sidedly conventionally, and which performs an advertisement interactively.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an electronic information contentdistribution processing system, an information distribution apparatus,an information processing apparatus, and an electronic informationcontent distribution processing method suitable to interactivelyoperating advertisement contents distributed by broadcasting orcommunication, and applying such contents to new electronicadvertisement media such that a user can enjoy like a game.

2. Description of the Related Art

Conventionally, according to an advertisement system represented by bigfour mass media such as television, radio, newspaper and journal, asender supply the contents of advertisement to a receiver one-sidedly.Its advertisement affect is limited to announcement and recognitionlevel of new target products. For a receiver, it is a main object tohear and read a main body of contents, and it is a basic style toattendantly hear, or read company products advertisements supplied atadd moments, resulting in recognition and understanding of anadvertisement target.

Therefore, in the case where an attempt is made to obtain furtherdetailed information on products recognized by this advertisementsystem, consumers arrange a manufacturer for documents, see actualmaterials at a store at which such products are present, and search thesame product information using another information media again. Forexample, according to an advertisement system caused by paper media suchas newspaper or journal, comparatively detailed product information canbe obtained. Product information is only read and seen as advertisementinformation obtained from such product information.

In addition, according to an advertisement system caused by broadcastingelectronics media using television or radio that is one of a highefficiency advertisement system, advertisements are inserted spot-likelybetween frames of providing programs with high visibility or highinterest or a programs (hereinafter, referred to as spot advertisement),thereby making it possible to ensure that many more consumers recognizeproduct information at home.

On the other hand, technical advancement of computer graphics isremarkable, and its high-level expression and compacted, lower-pricedreproduction apparatus are also significant. In addition, with thespread of personal computers, a banner advertisement system by internetis used. According to this banner advertisement, concerning anadvertisement interested by a consumer further new related home pagescan be opened by mouse clicking operation and the search can be easilymade by mouse operation.

In the meantime, such advertisement system has the following problems.

<1> According to broadcasting electronic media using television or radioand the like, information is transmitted one-sidedly from an advertiserto a receiver; an advertisement is displayed; and audio is output inreal time. Thus, there are often cases in which advertisementinformation is far away before consumers concentrate their consciousnesson such advertisement. In the case where an attempt is made to refer tothat advertisement again, advertisement information must be recorded ina recording medium such as a home server in a video tool such as videotape recorded (VTR) or home server.

However, the advertisement system using a recording medium of such typefor recording as well is limited to announcement or recognition of newproducts or company's idea. As in the advertisement system using papermedia such as newspaper or journal, the system is limited to reading orseeing level. If a receiver attempts to more deeply understand such newproduct or company's idea, an additional action such as another mediumsupervision or actual use experience at a store etc. is required.

<2> According to such broadcasting electronic media, a main object ofthe receiver is to obtain the broadcasting program contents (contentmain body) directly irrelevant to the advertisement contents. Thus, thereceiver feels resistance when an advertisement irrelevant to thecontent main body often appears. In addition, when a program is switchedto CM, a so called zapping action for switching a channel to another isperformed. Thus, there are often cases in which an advertisement effectcannot be obtained for the advertiser's desire. If a advertisement isreduced according to the receiver's quantity, the program cost isreduced. Thus, a “negative spiral” that the quality of content main bodyitself is lowered.

<3> In addition, according to an advertisement system using Internet, atelephone line is corrected during information search. Thus, thecommunication charge is increased, and certain time intervals arerequired for information search. Moreover, the advertisement informationobtained via Internet as well, corresponds to a visual/audio level suchas reading and seeing, as in the advertisement system of paper mediasuch as newspaper or journal. In order to obtain detailed advertisementinformation, the corresponding product must be actually seen.

SUMMARY OF THE INVENTION

The present invention has been made to solve such problems. It is anobject of the present invention to provide an electronic informationcontent distribution processing system, an information distributionapparatus, an information processing apparatus, and an electronicinformation content distribution processing method, which reverse aconcept of an advertisement which has been supplied one-sidedly, andwhich is capable of constructing electronic advertisement media forinteractively performing an advertisement.

The above mentioned problems are solved by a system of distributingelectronic information contents containing an advertisement, andinformation processing electronic information contents at the user side,said system characterized by comprising:

an information distribution apparatus for distributing said electronicinformation contents to a user; and

a plurality of information processing apparatuses for receiving andstoring the electronic information contents distributed from saidinformation distribution apparatus, reading out said electronicinformation contents according to a user operation, and processing theelectronic information contents, and then, outputting an advertisementvideo image and its audio.

The electronic information content distribution processing systemaccording to the present invention is characterized in that, in the casewhere electronic information contents containing an advertisement aredistributed to a user, and the electronic information contents areinformation processed at the user side, for example, the electronicinformation contents are distributed from the information distributiondevice to the user information processing apparatus by using a specificchannel for distributing only the electronic information contentsconcerning an advertisement. These electronic information contentscontain video image element information and audio information concerningan advertisement whose information can be operated in a user; andprogram information for processing these items of processing. Theelectronic information contents distributed from this informationdistribution apparatus are received and stored by an informationprocessing apparatus. Then, electronic information contents are read outaccording to a user operation, and the electronic information contentsare processed by the information processing apparatus, and then, anadvertisement video image and audio information are output.

Therefore, after receipt of electronic information contents, the usercan see an advertisement video image or hear audio information, theimage and audio information freely processed with respect to anadvertisement like playing a game in unreal time (asynchronously). Inthis manner, there can be constructed an electronic advertisement mediumreversing the conventional concept of an advertisement caused by bitfour mass media, the advertisement being supplied one-sidedly, andcapable of interactively performing an advertisement, and a newadvertisement mass medium following four mass-communication media can becreated.

Moreover, the user can operate an advertisement information mediumfreely and be enjoyable as compared with an advertisement which the usercan only see and hear, the user's interest is increased, and anadvertiser can implement an advertisement with its long life and highcommunication effect.

The information distribution apparatus according the present inventionis directed to an apparatus for distributing electronic informationcontents containing an advertisement, the apparatus comprising: a datainserter for constructing electronic information contents concerning anadvertisement in a group of data, thereby inserting the contents into acarrying signal; and a transmitter for transmitting the carrying signalobtained by constructing and inserting the data by this data inserter toa user information processing apparatus.

The information distribution apparatus according to the presentinvention is featured in that, in the case where electronic informationcontents containing an advertisement are distributed to a user by usingan existing broadcasting infrastructure, for example, electronicinformation contents concerning an advertisement are constructed in agroup of data, and is inserted into a carrying signal by means of a datainserter. The electronic information contents are provided so as to betransmitted by being multiplexed in a vertical blanking period of atelevision broadcast signal (carrying signal). A television broadcastsignal obtained by constructing and inserting the data by this datainserter is transmitted simultaneously from the transmiter to a user'sinformation processing apparatus.

Therefore, in the user's information processing apparatus, a group ofdata is received within a predetermined period, and can be stored in astorage device in batch. In this manner, after receipt of the electronicinformation contents, the user can see an advertisement video image andhear audio information, the image and information freely processed withrespect to an advertisement by means of the information processingapparatus in unreal time (asynchronously).

The information processing apparatus according to the present inventionis directed to an apparatus for information processing electronicinformation contents containing an advertisement, wherein electronicinformation contents are received and stored, electronic informationcontents are read out according to the user operation, and theelectronic information contents are processed, and then, outputting anadvertisement video image and audio information.

In the information processing apparatus according to the presentinvention, in the case where electronic information contents containingan advertisement are information processed, for example, upon receipt ofthe electronic information contents distributed using a specific channelthat distributes only electronic information contents concerning anadvertisement, the electronic information contents are temporarilystored in a non-volatile storage device or the like. Then, theelectronic information contents are read out asynchronously of areceiving operation according to the user operation, and the electronicinformation contents are arbitrarily information processed. For example,the video image element information and audio information concerning anadvertisement are arbitrarily processed by program information accordingto the user's information operation. The advertisement video image andaudio information after thus processed are output.

Therefore, after receipt of electronic information contents, the usercan see an advertisement video image or hear audio information, theimage and information freely processed with respect to an advertisementin unreal time (asynchronously) like playing a game. In this manner, newgame media following an arcade game, home use game machine, hand heldgame machine or the like. New media in which an entertainment device andadvertisement are fused can be created.

An electronic information content distribution processing methodaccording to the present invention is directed to a method for providinga user with electronic information contents containing an advertisement,and information processing electronic information contents at the userside, characterized in that electronic information contents aredistributed to the user, the thus distributed electronic informationcontents are received and stored, the electronic information contentsare read out according to the user operation, and an advertisement videoimage and audio information are reproduced based on the electronicinformation contents.

In the electronic information content distribution processing methodaccording to the present invention, the user can operate electronicinformation contents like playing a game, and thus, it can be expectedthat electronic information contents concerning an advertisement isspread spontaneously in an increased number of users who like to play agame. This contributes to introduction into a demand for a newadvertisement industry.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the present invention, reference is madeto the following detailed description, just in conjunction with theaccompanying drawings in which:

FIG. 1 is a block diagram depicting an exemplary configuration of anelectronic information content distribution processing system 10embodied according to the present invention;

FIG. 2 is a flow chart showing an example of processing in theelectronic information content distribution processing system 10embodied according to the present invention;

FIG. 3 is a flow chart showing another example of processing in theelectronic information content distribution processing system 10embodied according to the present invention.

FIG. 4 is a imaginary view showing an exemplary configuration of aninteractive advertisement system 100 that is a first embodimentaccording to the present invention;

FIG. 5 is a block diagram depicting an exemplary configuration of aninformation distribution apparatus 9 and its peripheral system embodiedaccording to the present invention;

FIG. 6 is an imaginary view showing an example of a format of a data.

FIG. 7 is an imaginary view showing an example of contents of theprogram information, video image element information, and audioinformation;

FIG. 8 is a block diagram depicting an exemplary internal configurationof an entertainment device 101;

FIG. 9 is an imaginary view showing an exemplary configuration of aninteractive advertisement, system 200 according to a second embodimentof the present invention.

FIG. 10 is a block diagram depicting an exemplary internal configurationof a tuner device 24 and a hand held terminal device 14;

FIG. 11 is a flow chart showing an exemplary operation of the tunerdevice 24 in the interactive advertisement system 200;

FIG. 12 is a flow chart showing an exemplary operation (main routine) ofa hand held terminal device 14 in the interactive advertisement system200.

FIG. 13 is a flow chart showing an example of processing (subroutine)according to the advertisement video image processing;

FIG. 14 is a block diagram depicting an exemplary internal configurationof a tuner device 24′ and a hand held terminal device 14 used in aninteractive advertisement system 300 that is a third embodimentaccording to the present invention;

FIG. 15 is an imaginary view showing an example of configuration of aninteractive advertisement system 400 that is a fourth embodimentaccording to the present invention;

FIG. 16 is an imaginary view showing an example of a format of a data inan advertisement program specific channel;

FIG. 17 is a block diagram depicting an exemplary internal configurationof a hand held terminal device 401; and

FIG. 18 is a flow chart showing an exemplary operation of the hand heldterminal device 401.

DESCRIPTION OF THE PREFERRED EMBODIMENT

Now, one embodiment of the electronic information content distributionprocessing system, information distribution apparatus, informationprocessing apparatus, and electronic information content distributionprocessing method, will be described with reference to the accompanyingdrawings.

(1) Embodiments

FIG. 1 is a block diagram depicting an exemplary configuration of anelectronic information content distribution processing system 10embodied according to the present invention.

In the present embodiment, this system comprises an informationprocessing apparatus for information processing electronic informationcontents containing an advertisement, wherein electronic, informationcontents that have been received and stored in advance are read outasynchronously according to a user information operation, and theelectronic information contents are processed, and then, outputting anadvertisement video image and audio information. In this manner, aconcept of an advertisement, the advertisement having been suppliedone-sidedly, is reversed, and electronic advertisement media thatperforms advertisement interactively can be constructed. Further, theuser can operate electronic information contents concerning anadvertisement freely and feels more enjoyable, the advertisement havingbeen just seen or heard.

The electronic information content distribution processing system 10shown in FIG. 1 is a system that distributes electronic informationcontents containing an advertisement to a consumer (hereinafter,referred to user Hj, j=1 to m), and information processes electronicinformation contents D0 at the user side. The electronic informationcontents D0 relates to a data on broadcasting program and anadvertisement. In this system 10, there is provided an advertisementspecific channel for distributing only electronic information contentsD0 concerning an advertisement like playing a game.

This is because electronic information contents D0 concerning anadvertisement that can be played free is provided to a prospect user Hjwho likes to play a game. The electronic information contents D0 containvideo image element and audio information D22 concerning anadvertisement whose information can be operated; a video image of theseitems of information D22; and program information D21 for audioprocessing. The electronic information contents D0 are provided to bedistributed to the user Hj by using a current broadcastinginfrastructure or a communication infrastructure.

In the case where a broadcasting infrastructure, for example, is used inthe electronic information content distribution processing system 10, aninformation distribution apparatus 19 is provided at a broadcast stationor the like, and the electronic information contents D0=D21+D22 isdistributed to the user. The information distribution apparatus 19 isprovided to distribute electronic information contents D0 concerning anadvertisement through an advertisement specific channel that has beenassigned in advance. At this information distribution-apparatus 19, atleast a data inserter 92 and a transmitter 1 are provided.

In the case where an advertisement specific channel is used, a pluralityof electronic information contents D0 concerning an advertisement areconstructed in a group of data at the data inserter 92. In the casewhere the electronic information contents D0, concerning anadvertisement are mixed at the data broadcast program channel, broadcastinformation contents D1 concerning an arbitrary data broadcastingprogram and electronic information contents D0 concerning anadvertisement are constructed at the data inserter 92 in a group ofdata. The broadcast information contents D1 are composed of audioinformation D11 and video image information D12 concerning an arbitrarydata broadcasting program (D1=D11+D12).

A transmitter 1 is connected to this data inserter 92, and the data aremultiplexed, for example, in a free space such as vertical blankingperiod of a television broadcast signal adopted by an existingbroadcasting infrastructure, then transmitted to the informationprocessing apparatus 8 of the user Hj. Namely, in the case where anadvertisement specific channel is used, electronic information contentsD0=D21+D22 are transmitted. In the case where a data broadcastingprogram channel is used, electronic information contents D0+broadcastinformation contents D1 are transmitted.

In this system 10, information processing apparatuses 8 are provided toa plurality of users Hj. The electronic information contents distributedfrom an information distribution apparatus 19 are received and stored,the electronic information contents are read out asynchronouslyaccording to a user operation, and the advertisement video image andaudio information obtained after the electronic information contentshave been arbitrarily processed are output.

Namely, a receiver 2 is provided at an information processing apparatus8, and a group of data (electronic information contents D0) transmittedfrom a transmitter 1 of the information distribution apparatus 19 isreceived. A control device 3 is connected to the receiver 2, and anon-volatile storage device (memory) 5 is connected to this controldevice 3. The electronic information contents D0 received by thereceiver 2 is stored (saved) in memory 5. Although the informationprocessing apparatus 8 will be described in each embodiment, anentertainment device comprising a receiving function, a tuner device andhand held terminal device combined with the receiver 2 and memory 5, anda hand held telephone set comprising a tuner function are configured.

A user interface 4 is connected to this control device 3. In thiscontrol device 3, electronic information contents D0 are read out from astorage device 5 according to operation inputs passed through userinterface 4, and electronic information contents D0 are informationprocessed so as to display and control an advertisement video image. Forexample, video image element and audio information D22 concerning anadvertisement is arbitrarily video imaged and audio processed based onprogram information D21 read out from the memory 5. Alternatively, adata broadcasting program is reproduced based on the broadcastinformation contents D1.

Items of operation inputs D3 and D4 concerning electronic informationcontents D0 are provided as input through user interface 4 connected tothis control device 3. They are intended to control input/output of thecontrol device 3 and receiver 2. They are generated by free operation ofoperating unit such as controller, by the user Hj. The broadcastinformation contents D1 and electronic information contents D0concerning an advertisement are read out from the memory 5 based on thisoperation information D3.

In addition, an interactive advertisement video image processed by thecontrol device 3 based on operation input D4 or a reproduced databroadcasting program is displayed on a monitor or the like (not shown).For example, in the case where a data broadcasting program channel isselected, the electronic information contents D0 and broadcastinformation contents D1 are already downloaded on the memory 5. Beforedisplaying the reproduced data broadcasting program, a spotadvertisement is displayed on the monitor based on video image, elementand audio information D22. In addition, when the data broadcastingprogram is ended, a spot advertisement based on these items ofinformation D22 is displayed.

Further, in this system 10, when a spot advertisement video image isdisplayed, a control program is executed such that the user can selectwhether or not to set a program reproduction mode or to set aninteractive advertisement operating mode. Here, the program reproductionmode denotes an operation for reproducing broadcasting informationcontents D1 according to a data broadcasting program. The interactiveadvertisement operating mode denotes an operation for video imaging andaudio processing the video image element and audio information D22 basedon items of operation inputs D3 and D4 through the user interface 4 andprogram information D21.

In the case where the interactive advertisement operating mode isselected, for example, program information D21 and the video imageelement and audio information D22 are read out from the memory 5 basedon the operation input D3 passed through user interface 4. Then, theseitems of information D22 are video imaged and audio processed based onthe program information D21 and operation input D4. Then, atwo-dimensional video image or a three-dimensional vide image concerninga least significant hierarchy of the display contents of a spotadvertisement video image is displayed on a monitor based on the videoimage processing.

In addition, in the case where an advertisement specific channel isselected, a plurality of electronic information contents D0=D21+D22 arealready downloaded on the memory 5. When electronic information contentsD0 concerning an arbitrarily selected advertisement are read out from aplurality of electronic information contents D0 downloaded on the memory5, the control device 3 is executed to reproduce video image element andaudio information D22 based on the electronic information contents D0,and is executed to display and control an advertisement video image thatconsists of a three-dimensional video image.

In this system 10, a priority is set in advance to any of the electronicinformation contents downloaded from the advertisement specific channel.Here, the priority denotes contents frequently displayed prior to anyother advertisement video image. Although the advertisement fee ishigher than that of another, there are more chances in which the user Hjsees and hears.

In this system 10, for example, before displaying an advertisement videoimage to which a priority is not set or an advertisement video imagewith a low priority, an advertisement video image to which such priorityis set or an advertisement video image with a high priority is alwaysdisplayed in an initial screen in order to cause the user Hj to see andhear it frequently. After ending the display of an advertisement videoimage to which a priority is not set or an advertisement video imagewith a low priority, an advertisement video image to which such priorityis set or an advertisement video image with a high priority may bedisplayed.

Further, when an advertisement video image to which a priority is set isdisplayed or after that, a control program may be executed so as todisplay a menu screen and select an arbitrary electronic informationcontents D0 among the electronic information contents D0 concerning aplurality of advertisements. The user Hj can select electronicinformation contents D0 concerning an advertisement in desiredcategories.

Now, an example of processing of the electronic information contentdistribution processing system 10 embodied according to the presentinvention will be described here.

In an example of the present embodiment, assume a case in whichelectronic information contents D0 containing an advertisement areprovided to a user using an existing broadcasting infrastructure orcommunication infrastructure, and the electronic information contents D0are information processed at the user side. The electronic informationcontents D0 concerning an advertisement assumes a case in which anadvertisement specific channel and a data broadcasting program channelare provided.

<1> In the Case of an Advertisement Specific Channel

First, at the transmission side, at the step A1 concerning a flowchartshown in FIG. 2, the video image element and audio information D22concerning an arbitrary interactive advertisement and programinformation D21 for video imaging and processing these items ofinformation D22 are constructed in a group of data at the data inserter92. The contents of interactive advertisement contain a variety ofelectronic information contents D0 including commodities such aselectric products, automobile, cosmetics, foods, game software; and realestates such as apartments or housings or the like. The electronicinformation contents D0 consists of video image element information suchas graphic data or sound data and audio information D22; and programinformation D21 such as application.

These electronic information contents D0 are provided in advance by aninteractive advertisement production environment, and are carried into adata broadcasting program production section. In this productionsection, video image element and audio information D22 concerning aplurality of advertisements; and program information D21 are constructedin a series of data.

Next, at the step A2, data are distributed from the transmission side tothe receiving side by using an existing broadcasting infrastructure orcommunication infrastructure. For example, in the case where data aredistributed by the broadcast infrastructure, an advertisement specificchannel is used. Namely, data are transmitted to be multiplexed from thetransmitter 1 of the information distribution apparatus 19 to theinformation processing apparatus 8 of the user Hj by using, a verticalblanking period of a TV broadcast signal caused by a terrestrial wavebroadcast. In the future, it is possible to directly multiplex the datato a television broadcast signal according to a broadcast form whichwill be newly adopted.

On the receiving side, a group of data sent from the informationdistribution apparatus 19 is received by the receiver 2 of eachinformation processing apparatus 8 at the step B1. These data are stored(downloaded) on a non-volatile memory 5 or the like. Then, processinggoes to the step B2 at which the video image element and audioinformation D22 and the program information D21 are read outasynchronously from the memory 5 according to information operation ofthe user Hj. At this time, the user Hj operates operating unit such ascontroller to provide operation input D4 for the control device 3. Then,at the step B3, advertisement video image and its audio are reproducedby the control device 3 based on the operation input D4 and electronicinformation contents D4. At this time, based on the program informationD21 read out from the memory 5 to the control device 3, the video imageelement and audio information D22 are video imaged and processed by thecontrol device 3.

In this system 10, the video image element and audio information D22 arevideo imaged and processed. In this way, an advertisement vide image towhich a priority is set or an advertisement video image with a highpriority is produced so as to be always displayed on an initial screenbefore displaying an advertisement video image to which a priority isnot set or an advertisement video image with a low priority with respectto an interactive advertisement, in order to ensure the user Hj sees andhears such advertisement frequently. The advertisement video image isproduced so as to operate a two-dimensional video image or athree-dimensional video image concerning a lower hierarchy of thedisplay contents of a spot advertisement like playing a game.

Further, when an advertisement video image to which a priority is set isdisplayed or after that, a menu screen is displayed, and a controlprogram is executed such that the user can select arbitrary electronicinformation contents D0 from among the electronic information contentsD0 concerning a plurality of advertisements. Here, the user Hj isprompted to select electronic information contents D0 concerning anadvertisement in a desired category. In this manner, an advertisementvideo image with a low priority or an advertisement vide image to whicha priority is not set is displayed.

Next, at the step B4, it is judged whether or not an interactiveadvertisement is ended. This judgment is made by the user. In the casewhether the advertisement is ended, for example, the power is turned OFFto end. In the case where these processing functions are not ended,processing goes to the step B2, for example, at which an advertisementvideo image to which a priority is set or an advertisement vide imagewith a high priority is displayed again.

<2> In the Case of a Data Broadcasting Program Channel

First, at the transmission side, at the step A1′ of the flow chart shownin FIG. 3, there are constructed in advance in a group of data;broadcast information contents (video image and audio information) D1concerning an arbitrary data broadcasting program; video image elementand audio information D22 concerning an arbitrary interactiveadvertisement; and program information D21 for video imaging andprocessing these items of information D22. As is the case of anadvertisement specific channel, an interactive advertisement denotescontents that can be played like a game provided in advance inaccordance with the interactive advertisement production environment.

Next, at the step A2′, data are distributed from the transmission sideto the receiving side by using an existing broadcasting infrastructureor communication infrastructure. For example, data are transmitted to bemultiplexed by using a vertical blanking period of a TV broadcast signalcaused by a terrestrial wave broadcast.

At the step B1′, a group of data are received on the receiving side bymeans of a receiver 2. These data are downloaded on a non-volatilememory 5 or the like. Then, processing goes to the step B2′ at which aspot advertisement concerning an interactive advertisement is alwaysdisplayed at the beginning of a data broadcasting program. Then, thestep goes to the step B3′ at which a control program is executed suchthat the user can select whether to set a program reproduction mode oran interactive advertisement operating mode.

Here, in the case where the program reproduction mode is selected,processing goes to the step B4′ at which the broadcast informationcontents D1 according to a data broadcasting program are read out fromthe memory 5 to the control device 3. Then, processing goes to the stepB5′, at which these broadcast information contents D1 are reproduced bythe control device 3.

In addition, in the case where the interactive advertisement operationmode is selected at the step B3′, processing goes to the step B6′ atwhich the program information D21 and the video image element and audioinformation D22 are read out from the memory 5 to the control device 3.Then, processing goes to the step B7′ at which the video image elementand audio information D22 is video imaged and processed by the controldevice 3 based on the operation input D4, passed through the userinterface 4 from the operating unit such as controller at which the userHj operates freely and the program information D21 read out from thememory 5.

In the present embodiment, the video image element and audio informationD22 is video imaged and processed. In this way, a two-dimensional videoimage or a three-dimensional video image concerning a least significanthierarchy of the display contents of a spot advertisement concerning aninteractive advertisement can be operated like playing a game. Then, atthe step B8′, an interactive advertisement or a data broadcastingprogram is provided to be displayed on a monitor or the like. Then, atthe step B9′, it is judged whether or not to end the programreproduction mode or the interactive advertisement operating mode andthe like. This judgment is made by the user.

In the case where these modes are ended, the power is turned OFF, forexample. In the case where these modes are not ended, processing goes,to the step B2′ at which a spot advertisement concerning an interactiveadvertisement is displayed based on the video image element and audioinformation D22 before displaying a data broadcasting program. It shouldbe noted that when the data broadcasting program is ended, a spotadvertisement may be displayed based on the video image element andaudio information D22.

In this manner, in the electronic information content distributionprocessing system 10 embodied according to the present invention, anytime after receipt of the electronic information contents D0, the usercan see an advertisement video image or hear audio information, theimage and information being freely processed with respect to anadvertisement, by the information processing apparatus 8, like playing agame, in unreal time (asynchronously). Thus, a concept of anadvertisement caused by big four mass media, the advertisement havingbeen supplied one-sidedly, is reversed, whereby an electronicadvertisement medium that performs an advertisement interactively can beconstructed, and a new advertisement mass media following such big fourmass communication media can be created.

Moreover, an advertisement specific channel that distributes onlyelectronic information contents D0 concerning an advertisement is usedinstead of an advertisement which the user only sees and hears. Thus,the user can download such advertisement at any time he or she likes,and can operate video image element and audio information D22 concerningan advertisement freely and feels more enjoyable. In this manner, theuser's interest is increased, and an advertiser can implement anadvertisement with its long life and high advertisement effect. The usercan handle a commodity virtually, and then, a high advertisement effectcan be expected.

Therefore, this makes it possible to contribute to the introduction intoa demand for a new advertisement industry. Hereinafter, embodiments offour interactive advertisement systems 100, 200, 300 and 400 will bedescribed. In the case where an advertisement specific channel is used,the electronic information contents D0 consist of program informationD21 and video image element and audio information D22. Thus, thecontents are generally referred to as interactive advertisement specificprogram information (hereinafter, simply referred to as advertisementinformation D2).

(2) First Embodiment

FIG. 4 is an imaginary view showing an exemplary configuration of aninteractive advertisement system 100 according to a first embodiment ofthe present invention.

A interactive advertisement system 100 shown in FIG. 4, is equipped witha tuner incorporated entertainment device 101 that is an example of aninformation processing apparatus and a television 102 that is an exampleof the monitor device. The entertainment device 101 is an example of acomposite processing apparatus, wherein electronic information contentsconcerning an advertisement (hereinafter, referred to as advertisementinformation D2) and broadcast information contents D1 are received andstored.

A coaxial cable 40 is connected to an entertainment device 101 to reacha coaxial terminal 44. An aerial wire antenna 42 is connected to thiscoaxial terminal 44, so that advertisement information D2 concerning adata broadcasting program and an interactive advertisement as well as TVprogram broadcast caused by a general terrestrial wave are received. Inaddition, an AC plug (alternating current plug) 48 to which power code46 is connected is provided at the entertainment device 101. The AC plugis connected to a power receptacle 50, and a commercially availablepower (also simply referred to as AC power supply) is supplied.

An interface function and a storage device are further provided at thisentertainment device 101, and a group of data (D1, D2) from a broadcaststation 9 are received, and stored in a non-volatile storage device. Anexternal controller 20 is connected to this interface. In addition, thedata is read out from the storage device to perform video imaging andprocessing. In this example, the external controller 20 is used so thatthe user can operate an interactive advertisement freely.

A television 102 that is an example of a monitor device can be connectedto this interface. Then, the electronic information contents D2 orbroadcast information contents D1 are read out from the entertainmentdevice 101 according to information operation of the user Hj, and anadvertisement video image and its audio are output after the electronicinformation contents D2 or broadcast information contents D1 have beeninformation processed asynchronously. For example, an interactiveadvertisement video imaged and processed by the entertainment device 101or reproduced data broadcasting program are displayed on a televisionscreen. An exemplary internal configuration of the entertainment device101 will de described in FIG. 8.

In this example, the advertisement information D2 according to thepresent invention together with a data broadcasting program beingcontents is broadcasted from the broadcast station 9 for home of ageneral user, and is received by the information processing apparatus 8via antenna of each home. Then, a data broadcasting program orinteractive advertisement is displayed on a television 102 or a monitorin unreal time (asynchronously) relevant to the broadcast station 9.

In addition to a specific console such as the above mentionedentertainment device 101, a home use game machine capable of plugging ina tuner function or a personal computer and the like may be used for theinformation processing apparatus. For a display device, there may beused an integration type hand held terminal device that incorporates atuner function in addition to an existing television 102 or a personalcomputer monitor. Further, the external controller 20 may be of wirelesstype using infrared ray or electric wave in addition to wired typegenerally used for a home use game machine or may be compatible with aremote control function generally used for a television 102 or a videorecorder.

Now, an information distribution apparatus 19 disposed at a broadcaststation 9 or the like responsible for information distribution will bedescribed below. FIG. 5 is a block diagram depicting an exemplaryconfiguration of an information distribution apparatus 19 and itsperipheral environment embodied according to the present invention. Inthis example, a data broadcasting infrastructure for sending data byusing an analog terrestrial wave VBI is used for televisionbroadcasting.

The information distribution apparatus 19 shown in FIG. 5 is anapparatus that distributes advertisement information D2 concerning adata broadcasting program and an interactive advertisement as well as aTV program broadcast caused by general terrestrial waves. In thisexample, a client such as company asks a commercial (hereinafter, simplyreferred to CM) production company having interactive advertisementproduction environment for CM production directly or throughadvertisement agent.

Through the inquiry of an advertiser 99, advertisement information D2concerning interactive advertisement including commodities such aselectric products, automobiles, cosmetics, foods, game software; andreal estates such as apartments or housings is produced in advance inaccordance with an interactive advertisement production environment, andmany interactive advertisements after completed are brought into a databroadcast advertisement program production section. In this section,broadcast information contents D1 concerning a data broadcastingprogram; video image element and audio information D22 such as graphicdata or sound data concerning an interactive advertisement;advertisement information D2 consisting of program information D21 suchas application are organized in accordance with a CM table scheduled inadvance.

A general terrestrial television program is produced by a televisionprogram production company as usual, and another advertiser 99 asks a socalled commercial (CM) video to be supplied at an interval of suchtelevision program. A complete packet program produced by a televisionprogram production company is organized in accordance with a programtable in a television station, and is broadcasted after transmissionprocessing has been done. Namely, the information distribution apparatus19 comprises an inserter 92 for inserting a data broadcasting program;interface 94; a program organization processing unit 93 for a generaltelevision program; interface 94; a transmitter 95; and an antenna 98.

This inserter 92 is provided as an example of a data inserter. Thisinterface 92 is provided to construct at least broadcast informationcontents D1 concerning a data broadcasting program D1; video imageelement and audio information D22 such as graphic data or sound dataconcerning an interactive advertisement; and program information D21such as application in a group of data, and to transfer these data to aninserter 29.

On the other hand, television program information and commercial videocaused by a terrestrial broadcast are provided by a television programproduction company. The television program information and commercialvideo are sent to a transmission interface 94 after organized by aprogram organization processing unit 93 of an information distributionapparatus 19. In the transmission interface 94, the program organizedtelevision program information and commercial video are converted into apredetermined broadcast format, and then, the converted data is providedas a TV broadcast signal caused by terrestrial wave broadcast (carryingsignal).

An inserter 29 is connected to an output stage of this transmissioninterface 94, and a transmitter 95 is connected to its next stage. In avertical blanking period, for example, of the above mentioned TVbroadcast signal, the broadcast information contents D1 concerning adata broadcasting program and advertisement information D2 concerning aninteractive advertisement are arranged in a group of data, and aremultiplexed (VBI). This insertion is arranged to be performed atmidnight. A group of data inserted into this inserter 29 is irradiatefrom an antenna 98 simultaneously by means of predetermined distributionpower after the data has been modulated at the transmitter 95 by meansof a predetermined modulation system.

In this manner, the broadcast information contents D1 or advertisementinformation D2 concerning an interactive advertisement can be broadcastfrom the broadcast station 9 to the user's entertainment device 101. Ofcourse, the advertisement information D2 is provided so that theinformation may be distributed to the user Hj through an advertisementspecific channel that has been assigned in advance (refer to fourthembodiment). In this case, this interactive broadcast is irrelevant toan interactive advertisement broadcast using the contents main body anddata broadcast of a terrestrial waves in contents. This means that thesame distribution infrastructure is used for a totally irrelevantreceiving system.

Therefore, in the entertainment device 101 with a tuner function,possessed by a user and a hand held terminal device as described later,a group of data can be received simultaneously in a predetermined periodof time, and can be stored in batch in a storage device or the like. Inthis manner, after receipt of such data, the user reads out data fromthe storage device at any time he or she likes; video images and audioprocesses video image element and audio information D22 based on programinformation D21 in unreal time (asynchronously) irrespective of atelevision broadcast time; reproduces broadcast information contents D1according to a data broadcasting program; displays a data broadcastingprogram such as interactive advertisement or animation on a television102, thereby making it possible to see and hear it freely.

Now, a format of data of program information D21, video image elementand audio information D22 will be described here. With respect to thedata shown in FIG. 6, a format is provided in advance at a broadcaststation 9 or the like, and the data main body is transmitted to bedivided into each packet.

In this example, a transfer request command is described at thebeginning of data so as to enable automatic receiving in a tuner device101 even at midnight. The transfer request command is data forinitializing (starting up) a tuner device 101 in a standby state. Adummy packet following this transfer request command is inserted. Thedummy packet is provided to form a setup period. The setup period is atime required for the tuner device 101 to be receivable.

A set of program data is all described after this setup period. Programdata is described in a bit data format, and broadcast informationcontents D1 concerning a data broadcasting program and advertisementinformation D2 concerning an interactive advertisement are targeted.Program data is nominally described without being discriminated frominteractive advertisement or program codes, video images, or audioinformation.

A program start command is described at the beginning of the programdata, and N+1 blocks 0 to N are described subsequently. Advertisementinformation D2 concerning the above mentioned interactive advertisementor program codes and content codes of broadcast information contents D1are described in units of blocks. Block 0 is a start block, and block Nis a last block. Following block N, a block last command is described. Ablock header is described at the beginning of each of blocks 0 to N, forexample, block 1. Header codes, attributes such as the start, middle,and end of the block, block length such as the number of packets,content codes or the like are described at each block header.

Following this block header, M+1 packets are described in each block.Packet 0 is a start packet, and packet M is a last packet. Packet codes,attributes such as the start, middle, and end of the packet, errorcorrection codes such as parity are described at the packet 1, forexample of the packets 0 to M. FIG. 7 shows exemplary contents of theprogram information D21 and video image element information D22described in this packet.

A file header, program information D21, video image element and audioinformation D22 are described at a packet shown in FIG. 7. Following thefile header, application main body containing a polygon drawing command;and program information D21 consisting of a module group such assubroutine of this application and a library group are described.

In this application, program data is described such that the user canselect whether to set a program reproduction mode, for example, or toset an interactive advertisement operation mode. In addition, a controlprogram is also described such that in the case where a priority is setto an advertisement video image, when such advertisement video image isdisplayed, the user can select arbitrary advertisement information D2from the advertisement information D2 concerning a plurality ofadvertisements.

Following this program information D21, video image element and audioinformation D22 are described. For example, there is described a graphicmodel data group containing moving image data such that a spotadvertisement according to the entire appearance of a vehicle, forexample, is displayed as a two-dimensional or three-dimensional videoimage. The moving image data is compressed by DCT (distance cosinetransformation). With respect to moving image data, apart from theentire appearance of a vehicle, there is described two-dimensional orthree-dimensional video image element data of vehicle sheets, openingand closing doors, the inside of the trunk, or engine room or the likeconcerning a least significant hierarchy of its display contents.

Following a graphic model data group, a graphic texture data group isdescribed. Furthermore, texture data is provided to configure 1-polygonshape data in 76 bytes. 1 polygon is expressed by a triangle havingthree vertexes, and texture ID is described at the beginning of shapedata. Then, each of the X, Y and Z coordinates of a first vertex of thetriangle is described, and the color value of the first vertex andtexture U and V coordinates are described. Subsequently, each of the X,Y and Z coordinates of a second vertex is described, and the color valueand texture U and V coordinates of a second vertex are described.Further, each of the X, Y and Z coordinates of a third vertex isdescribed, and the color value and the texture U, V coordinate of athird vertex is described.

These items of texture data are serially provided so as to connect thevertexes of a triangular shape to each other according to a useroperation. Then, coordinate conversion is made for each vertex, rasterprocessing is performed for each polygon, and the color texture address(U, V) of each pixel is computed. Then, the texture color of the U and Vcoordinates of each pixel is computed by performing raster processingfor each polygon. Then, the texture color of the U and V coordinates areread out from texture data specified by texture ID, the color value, ofeach pixel is determined, and a three-dimensional advertisement image isdisplayed on a monitor based on this color value.

In addition, a sound sequence data group is described as video imageelement information, and a sound wave data group is described as audioinformation. Sound wave data is processed according to a user operationand sound sequence, and is provided so as to generate door opening andclosing sound, trunk opening and closing sound, and engine rotationsound or the like. These groups of data are provided so as to bedistributed from the information distribution device 19 to theentertainment device 101 or the like within a predetermined period oftime.

Now, an exemplary internal configuration of an entertainment device 101applied in an interactive advertisement system 100 will be describedhere. FIG. 8 is a block diagram depicting an exemplary internalconfiguration of the entertainment device 10.

In this example, a user can select a game mode for executing a gamebased of data from an optical disk device; the above mentioned programreproduction mode; or interactive advertisement operating mode. Namely,the entertainment device 101 comprises: a control system 500 consistingof a tuner 21 for receiving a group of data (D1+D2) from an informationdistribution apparatus 19 within a predetermined period of time; anon-volatile memory (storage device) 23 for storing a group of datareceived by this tuner 21; a central processing unit (CPU) 51 that is acomputing unit for reading out the program information D21 from thememory 23 to arbitrary video imaging and processing video image elementand audio information D22 based on the program information D21, orreproducing a program based on broadcast information contents D1 and itsperipheral units or the like; a graphics system 600 consisting of agraphic processing unit (GPU) 62 or the like for drawing an image in aframe buffer 63; a sound system 700 consisting of a sound processingunit (SPU) 71 or the like for generating music sound, effect sound orthe like; an optical disk controller 800 for controlling the opticaldisk in which application program is recorded operated to control atleast a control system 500; an external controller 20 that is anoperating unit controlling at least control system 500; a communicationcontrol system 900 for controlling an input/output of data from theexternal controller 20 and a memory card for storing settings of signalsand games from an external controller 20 to which a user's command isinput; a communication modem 22 connected to a telephone line orInternet; and bus to which each of these units is connected or the like.

This control system 500 comprises a CPU 51; a peripheral unit controller52 for performing interrupt control or direct memory access (DMA)transfer control or the like; a main memory (main memory device) 53consisting of a random access memory (RAM); and a read only memory (ROM)storing programs such as so called operating system managing the mainmemory 53, graphic system 600, and sound system 700 or the like. Themain memory 53 used here can execute a program on that memory. When inan interactive advertisement operation mode, program information D2.1stored in a memory 23 is used.

A CPU 51 controls the entirety of this entertainment device 101 byexecuting an operating system stored in a ROM 54, and consists of a 32bits RISC-CPU, for example. When such interactive advertisementoperating mode is executed, video image element and audio informationD22 are video imaged and processed based on program information D21 readout from the memory 23. A flash memory such as EEPROM is used for anon-volatile memory 23. When a RAM is used, a backup power source or thelike is used to provide non-volatile properties.

When this entertainment device 101 is powered ON, the CPU 51 of thecontrol system 500 executes an operating system stored in the ROM 54 ormemory 23 according to the game mode, program reproduction mode orinteractive advertisement operating mode. In this manner, the CPU 51controls a graphic system 600 or sound system 700 and the like.

In addition, when an operating system is executed, the CPU 51initializes the entirety of the entertainment device 101 such asoperational checks. Then, the CPU 51 controls this optical diskcontroller 800. When in a game mode, the CPU executes an applicationprogram such as game recorded in an optical disk. In this example, henin an interactive advertisement operating mode, operation substantiallyidentical to game mode can be performed based on the program informationD21 and video image element and audio information D22 read out from thememory 23.

Therefore, by executing a program such as game mode or interactiveadvertisement operating mode, the CPU 51 controls this graphic system600 or sound system 700 and the like according to the user input so asto control image display or generation of an effect or music sound andthe like.

In addition, this graphic system 600 displays and controls at leastadvertisement video image or program video image operated by theexternal controller 20. The graphic system comprises: a geometrytransfer engine (GTE) 61 that processes coordinate conversion or thelike that configures a computing uniti; a GPU 62 that draws an image inaccordance with an image drawing command from the CPU 51; a frame buffer63 for storing an image drawn by this GPU 62; and an image decoder 64for decoding image data compressed and encoded by orthogonal conversionsuch as discrete cosine conversion. A television 102 is connected to theGPU 62, and video output signals φv such as the game video image, databroadcasting program video image and interactive advertisement videoimage are supplied to the GPU 62.

This GTE 61 comprises a parallel computation mechanism that executes aplurality of computations in parallel, for example so that computationssuch as coordinate conversion, light source calculation, matrix orvectors can be performed speedily according to a computation requestfrom this CPU 51. Specifically, in the case of computation forperforming flat shading for image drawing a polygon of one triangularshape in the same color, for example, this GTE 61 can perform coordinatecomputation for a maximum of about 1,500,000 polygons per second,whereby this entertainment device 101 can reduce a burden of the CPU 51,and perform high speed coordinate computation.

In addition, this GPU 62 draws an image such as polygon relevant to aframe buffer 63 in accordance with a image drawing command from the CPU51. This GPU 62 can perform image drawing for a maximum of about 360,000polygons per second. Further, this frame buffer 63 consists of a socalled dual port RAM. The buffer can perform transferring of imagedrawing from the GPU 62, or from the main memory 53 or the memory 23,and readout for display, simultaneously.

This frame buffer 63 has a capacity, for example, of 1 M byte, and ishandled as a matrix that consists of 1024 pixels horizontally and 512pixels vertically, respectively, in 16 bits. In addition, in this framebuffer 63, apart from a display region output as a video output, thereare provided a CLUT region for storing a color lookup table (CLUT) to bereferred to when the GPU 62 draws an image such as polygon; and atexture region for storing an element (texture) to be inserted (mapped)in a polygon or the like coordinate converted during image drawing andimage drawn by the GPU 62. These CLUT region and texture region aredynamically changed in accordance with display region change or thelike.

This GPU 62 can perform: grow shading for causing interpolation from acolor of a polygon vertex, thereby determining the color in the polygon,apart from the above mentioned flat shading; and texture mapping formapping a texture stored in this texture region to the polygon. In thecase where these grow shading or texture mapping is performed, this GTE61 can perform coordinate computation for a maximum of about 500,000polygons per second.

Further, an image decoder 64, under control of this CPU 51, provided todecode and store in the main memory 53 is image data which is on stillimage or moving image concerning game, data broadcasting program oradvertisement and stored in a main memory 53 or memory 23. The audio andvideo image information D1 reproducing a data broadcasting program orimage data reproduced by an optical disk device is stored in a framebuffer 63 via the GPU 62, whereby these information or data can be usedas a background of an image drawn by the above mentioned GPU 62.

A sound system 700 comprises: an SPU 71 for generating a music or effectsound based on a command from the CPU 51; a sound buffer 72 forrecording waveform data or the like or recording sound data concerninginteractive advertisements stored in the memory 23; and a speaker 73 foroutputting a music or effect sound generated by the SPU 71.

The SPU 71 comprises an ADPCM decoding function for reproducing audiodata generated by adaptively predicting and encoding (ADPCM: AdaptiveDifferential PCM) a 16-bit audio data as a 4-bit differential signal; areproduction function for reproducing waveform data stored in the soundbuffer 72, thereby generating an effect sound or the like; and amodulation function or the like for modulating and reproducing waveformdata stored in the sound buffer 72.

By providing such function this sound system 700 can be used as a socalled sampling sound source for generating a music or effect sound orthe like based on waveform data recorded in a sound buffer 72 by acommand from the CPU 51. This optical disk controller 800 comprises: anoptical disk device 81 for reproducing programs or data and the likerecorded in an optical disk; a decoder 82 for decoding programs or dataand the like recorded with error correction codes (ECC) added thereto;and a buffer 83 for speedily reading-out data from an optical disk bytemporarily storing data from the optical-disk device 81.

In addition, audio data recorded in an optical disk read out by theoptical disk device 81 includes so called PCM data obtained byanalog/digital converting an audio signal as well as the above mentionedADPCM data. As ADPCM data, audio data recorded with a difference in16-bit digital data being expressed in 4 bits is decoded by means of adecoder 82. The decoded data is supplied to the above mentioned SPU 71.Then, the supplied data is subjected to processing such asdigital/analog conversion in the SPU 71, and then, is used to drive thespeaker 73. In addition, as PCM data, for example, audio data recordedas 16-bit digital data is decoded by means of the decoder 82, and then,is used to drive the speaker 73.

Further, a communication control system 900 comprises: a communicationcontroller 91 that controls communication with the CPU 51 via a bus; anda communication modem 22 for receiving also advertisement information D2or the like concerning an interactive advertisement. A controllerconnection terminal 12 is connected to the communication controller 91,and an external controller 20 for inputting operation input D3 from theuser is connected. A telephone line or Internet is connected to thecommunication modem 22. In addition, a memory card inserter to which amemory card or a hand held terminal device or the like is connected asan auxiliary storage device for strong game setting data or the like isprovided at performed. In addition, a parallel I/O interface (PIO) 96and a serial I/O interface (SIO) 97 are interfaces for connecting anexternal expansion device and the entertainment device 101 to eachother.

Now, an example of processing in an interactive advertisement system 100will be described here by using the flow chart at the receiver sideshown in FIG. 3.

In the present embodiment, assume a case in which data concerning a databroadcasting program or interactive advertisement are distributed fromthe broadcast station 9 to the entertainment device 101 by using anexisting terrestrial wave broadcasting infrastructure. Such case isexemplified that at the transmission side, broadcast informationcontents D1 concerning a data broadcasting program, and for example,advertisement information D2 concerning vehicle sales are provided, andthese data are transmitted to be multiplexed by using a verticalblanking period of a TV broadcast signal. Assume a case in which gamemode is determined in advance not to be selected

With these cases being assumed, at the receiver side, when apredetermined time comes, a transfer request command is automaticallyreceived. After the setup period, at the step B1 in the flow chart shownin FIG. 3, the broadcast information contents D1 concerning a databroadcasting program and a group of data consisting of advertisementinformation D2 concerning vehicle sales are received by means of a tuner21 through an antenna 42, a coaxial terminal 44, and a coaxial cable 40.These data are decoded by means of a decoder circuit (not shown)incorporated in the tuner 21, and then, is writing controlled by meansof the CPU 51 to be stored in a non-volatile memory 23 or a main memory53 with a backup function.

When all the data are received, it reverts to a standby state. Then, thestandby state is released, for example, and processing goes to the stepB2′. At this step, if a game mode is set to be deselected, a spotadvertisement according to the appearance of the entire vehicle isalways displayed as a two-dimensional or three-dimensional image withrespect to an interactive advertisement at the beginning of a databroadcasting program. Then, processing goes to the step B3′ at which aapplication is executed such that the user can select whether or to seta program broadcast mode or to set an interactive advertisementoperating mode.

Here, in the case where the program reproduction mode is selected,processing goes to the step B4′ at which broadcast information contents(audio and video image information) D1 according to a data broadcastingprogram are read out from the memory 23 to a control system 500. Then,processing goes to the step B51 at which a graphic system 600, a soundsystem 700 or the like is controlled by means of a control system 500,whereby the broadcast information contents D1 are reproduced.

In addition, in the case where the interactive advertisement operatingmode is selected at the step B3′, processing goes to the step B6′ atwhich program information D21 and video image element and audioinformation D22 according to an interactive advertisement of a vehicleare read out from the memory 23 to the controller 500. Then, processinggoes to the step B7′ at which the graphic system 600, sound system 700and the like are controlled by means of the control system 500 based onoperation input D4 from the external controller 20 that the useroperates freely and the program information D21 read out from the memory23, whereby the video image-element and audio information D22 aresubject to video image processing such that a three-dimensional and highresolution video image when a vehicle is seen at a variety of angles isdisplayed.

In this example, the video image element and audio information D22 arevideo imaged and processed by means of the CPU 51, whereby athree-dimensional image of vehicle sheets, door opening and closing, theinside of the trunk, and the inside of engine room or the like can beoperated with respect to the least significant hierarchy of the displaycontents of the spot advertisement of a vehicle like playing a game. Atthe step B8′, an interactive advertisement or data this communicationcontroller 91 (not shown).

The external controller 20 connected to this controller connectionterminal 12 has 16 command keys, for example, to input a command fromthe user. The states of these command key are distributed to thecommunication controller 91 about 60 times per second by synchronouscommunication in accordance with a command from the communicationcontroller 91. Then, the communication controller 91 distributes thestate of a command key of the external controller 20 to the CPU 51. Inthis way, the command from the user is input to a CPU 51. This CPU canperform processing in accordance with a user command based on theinteractive advertisement operating mode or game mode and the like beingexecuted.

Here, it is required to transfer a large amount of data at a high speedwhen a program is read out or an image is displayed or drawn among thememory 23, main memory 53, GPU 62, image decoder 64, and decoder 82 orthe like. At this entertainment device 101, as described above, socalled. DMA transfer for directly transferring data among the mainmemory 53, GPU 62, image decoder 64 and decoder 82 or the like can beperformed under the control of a controller 52 of a peripheral devicewithout intervening the CPU 51. In this manner, a burden of the CPU 51caused by data transfer can be reduced, and high speed data transfer canbe broadcasting program is provided so as to be displayed on atelevision 102 or the like. At the step B9′, it is judged whether or notthe game mode, program reproduction mode, or interactive advertisementoperating mode and the like is ended. This judgment is made by the user.

In the case where these modes are ended, power is turned OFF, forexample. In the case where these modes are not ended, processing revertsto the step B2′ at which a spot advertisement concerning an interactiveadvertisement is displayed based on video image element and audioinformation D22 before displaying a data broadcasting program. When thedata broadcasting program is ended, a spot advertisement may bedisplayed based on the video image element and audio information D22.

In this manner, in the interactive advertisement system 100 that is afirst embodiment according to the present invention, an interactiveadvertisement or reproduced data broadcasting program consisting of athree-dimensional video image of vehicle sheet, door opening or closing,the inside of the trunk, or the inside of engine room, which are videoimaged and processed by the control system 500, graphic system 600 andsound system 700 asynchronously relevant to a terrestrial broadcast isdisplayed on the television 102 or the like, whereby the user can see orhear it freely at any time he or she likes or can play it like playing agame.

In this way, a concept of big four mass media advertisement, theadvertisement having been supplied one-sidedly, is reversed, and a newgeneration electronic advertisement medium for interactively performingadvertisement can be constructed. Moreover, the user can operate aninteractive advertisement enjoyably by using an external controller 20like playing a game as compared with a conventional type ofadvertisement that has only been seen or heard. Thus, in the future, aninteractive advertisement can be expected to naturally spread in anincreased number of users who likes to play a game.

The user's interest is increased unconsciously, and thus, an advertise99 can carry out an advertisement with its high advertisement effect.This greatly contributes to the introduction into a demand for newinteractive advertisement industry. In this manner, new game mediafollowing arcade game, home use game machine, hand held game machine orthe like can be created. That is, a new media fusing the entertainmentdevice 101 and advertisement can be created.

(3) Second Embodiment

FIG. 9 is an imaginary view showing an exemplary configuration of aninteractive advertisement system 200 that is a second embodimentaccording to the present invention,

In this system 200, a system for seeing and hearing an interactiveadvertisement is configured by a hand held terminal device 14 shown inFIG. 9, instead of the television 102 applied in the first embodiment.As an information processing apparatus, a tuner device 24 with a powercharge function and a hand held terminal device 14 mountable to thistuner device 24 are provided, and a non-volatile storage device forstoring data is provided in the tuner device 24.

This tuner device 24 is similar to that in the first embodiment in thatthe advertisement information D2 according to a data broadcastingprogram and an interactive advertisement is received and stored. Insteadof outputting this information to the television 102, and operating aninteractive advertisement by means of the external controller 20, thebroadcast information contents D1 concerning a data broadcasting programstored in the tuner device 24 and the advertisement information D2concerning an interactive advertisement are downloaded-on the hand heldterminal device 14, so that the user operates the video image or audioconcerning an interactive advertisement by using a liquid crystaldisplay monitor 122 and an operation key 32 of the hand held terminaldevice 14.

A general-purpose serial interface (wired or wireless) such as USB orIEEE 1394 and IrDA is used for downloading from this tuner device 24 tothe hand held terminal device 14. In addition, a dedicated interface orthe like for directly connecting a wired device, a wireless device, or aconnector may be provided at the tuner device 24. The data received bythe tuner device 24 may be directly stored in a non-volatile memory orhard disk unit in the hand held terminal device 14 without being storedin the tuner device.

The tuner device 24 with the power charge function shown in FIG. 9 has atuner (not shown) so as to receive a group of data such as the broadcastinformation contents D1 or advertisement information D2 or the likedistributed from the broadcast station 9. The hand held terminal device14 can be connected to the tuner device 24, and a group of datadownloaded from the tuner device 24 are image processed.

This hand held terminal device 14 comprises an operation key 32 and aliquid crystal display monitor 122 that is a display unit. Theinteractive advertisement video image or data broadcasting programoperated by this operation key 32 are displayed on the liquid crystaldisplay monitor 122.

This liquid crystal display monitor 122 has, for example, a color liquidcrystal screen with 320 pixels×240 pixels. At its lower end side, thishand held terminal device 14 is inserted into a recess 18 of the tunerdevice 24, whereby a secondary battery incorporated in this hand heldterminal 14 is charged.

At a casing 26 of the hand held terminal device 14, apart from the abovementioned liquid crystal display monitor 122, there are provided a crosskey 28 and an OK key 30 configuring the operation key 32. Although thecross key 28 and OK key, 30 are operated to control a computing unitdescribed later, the OK key functions as a power switch of the hand heldterminal device 14.

On the other hand, at a casing 34 of the tuner device 24 with a powercharge function, apart from the above recess 18, there are provided apower charge display lamp 36 indicating a charge state such as theprogress or end of power charge; a reception indicating lamp 37indicating that the hand held terminal device 14 is receiving data; achannel selection switch 38 for selecting a desired broadcast channel ina data broadcast. The advertisement specific program channel can be seenand heard when the channel selection switch 38 is set to channel 100,for example. Of course, in this case, the channel 100 is used as anadvertisement specific channel at the broadcast station 9.

Further, a coaxial cable 40 is connected to this tuner device 24 with apower charge function to reach a coaxial terminal 44. An aerial wireantenna 42 is connected to this coaxial terminal 44, so thatadvertisement information D2 concerning a data broadcasting program andan interactive advertisement as well as TV program broadcast caused by ageneral terrestrial wave are received. In addition, an AC plug(alternating current plug) 48 to which power code 46 is connected isprovided at the tuner device 24. The AC plug is connected to a powerreceptacle 50, and a commercially available power (simply referred to asAC power supply) is supplied.

FIG. 10 is a block diagram depicting an exemplary internal configurationof the tuner device 24 and hand held terminal device 14. In FIG. 10, thetuner device 24 with its power charge function has a tuner 55 forreceiving externally supplied data. This tuner 55 extracts data such asbroadcast information contents D1 according to a data broadcastingprogram or advertisement information D2 according to an interactiveadvertisement from the terrestrial wave broadcast signal received by theantenna 42, and sends them to a bus 57.

In the present embodiment, the broadcast information contents D1according to a data broadcasting program or advertisement information D2according to an interactive advertisement are multiplexed, for example,by using a vertical blanking interleaving interval (VBI) that is aninterval of electronic broadcast waves using an NTCS system that is aterrestrial wave television broadcast. A variety of digital contents canbe distributed (the contents used here include a variety of informationsuch as video images, images (moving and still pictures), audio,characters, numerals; a program or CM reproduced by a televisionreceiver or radio receiver; and the contents of journals or newspaper).Therefore, the television broadcast waves of this terrestrial waves canbe received by means of the antenna 42 such as conventional Yagiantenna.

Television broadcast waves include a plurality of channel waves. Inorder to select and receive a desired channel, the selection frequencyof a tuner 55 can be switched through a channel selection circuit 56based on the channel information set by the channel selection switch 38(also refer to FIG. 9).

The data (here, referred to as NTSC signal) selected by this tuner 55and supplied to a bus 57 is decoded by means of a data decoding circuit58. When a data according to the above various contents multiplexed as aVBI is present in such NTSC signal, the decoded data such as broadcastinformation contents D1, program information D21, and video imageelement and audio information D22 is temporarily stored in a flashmemory 33, including a case in which a hand held terminal device 14 isnot set under the control of a microcomputer 90 that functions as areception controller or the like.

When the hand held terminal device 14 is set, data may be directlytransferred simultaneously to the hand held terminal device 14 throughan external interface 60 that is a serial interface or a connectionterminal 65. In this case, the data decoding circuit 58 andmicrocomputer 90 may be configured in an integrated system LSI. The datasent to the hand held terminal device 14 through the connection terminal65 is electrically written in a data storage 75 or flash memory 43 thatis an example of a non-volatile storage device under the control of amicrocomputer 70 through a connection terminal 69 of this hand heldterminal device 14, an external interface 67 and a bus 74 that areserial interfaces.

A read only memory (EEPROM) or the like in which information can bewritten and erased is used for this storage device. In this example,even if the hand held terminal device 14 is not set to a tuner device24, data such as broadcast information contents D1 or advertisementinformation D2 are electrically stored in the flash memory 33. When thehand held terminal device 14 is set to the tuner device 24, data aretransferred to a data storage (storage device) 75 of the hand heldterminal device 14 under the control of a microcomputer 90.

The storage capacity of flash memories 33 and 43 or data storage 75 maybe 16 [MB] in the case where a data rate of a data broadcast is about 40[kbps] and an attempt is made to store the data at least for about 50minutes. 40 [kbps]/8 [bits]×50 [minutes]×60 [seconds]=15 [MB].

The micro computer 70 is a digital computer that is provided as anexample of a computing unit. This computer arbitrarily video images andprocesses the video image element and audio information D2.2 based onthe program information D21 read out from the data storage 75 orreproduces a complete packet program based on the broadcast informationcontents D1.

The microcomputers 70 and 90 each have: CPU (central processing device);a ROM (including EEPROM) that is a memory; a RAM (random access memory):an input/output interface, a clock that is a clock device; and a timethat is a timer device or the like, and functions as a controller, acomputing unit, a processing unit or the like. Therefore, as describedabove, the function of the data decoding circuit 58 can be executed bymeans of the microcomputer 90.

A reception indicating lamp 37 is connected to the microcomputer 90 atthe side of the tuner device 24. This reception indicating lamp 37 iscontrolled to turn ON while data is transferred from the tuner device 24to the data storage 75 and while data is stored in the data storage 75and to turn OFF in the other cases. The reception indicating lamp 37 mayblink when data reception has been completed.

The tuner device 24 further has a power circuit 80. This power circuit80 converts an alternating current voltage such as 100 ACV supplied froman external AC power source to direct current voltage, and supplies thevoltage to all the blocks in the tuner device 24. In this case, a powercharge control circuit 85 converts the direct current voltage suppliedfrom the power circuit 80 into a power charge direct current, forexample, supplies the current to a secondary battery 87 of the hand heldterminal device 14 via a connection terminal 68 of the hand heldterminal device 14 through the connection terminal 66, and controlspower charge. The power charge control included in the power chargecontrol circuit 85 controls a charge current while detecting atemperature of a secondary battery 87, and performs remaining capacitydetection and control and battery full charge detection and control ofthe secondary battery 87. As the secondary battery 87, a lithium ionbattery or nickel hydrogen battery and the like can be used.

A charge indicating lamp 36 is connected to the charge control circuit85. This charge indicating lamp 36 is controlled to turn ON while thepower of the secondary battery 87 is charged and to turn OFF when thebattery is full. Further, the operation key 32 is connected to the handheld terminal device 14 via a bus 74 and an interface 86, and a liquidcrystal display monitor 122 is connected thereto via a liquid crystaldisplay controller (LCDC) 88. An audio processing unit 76 is connectedto the above mentioned bus 74, and audio amplification processing or thelike is performed. A speaker 77 is connected to an audio processing unit76 so as to output audio information concerning a data broadcastingprogram or interactive advertisement.

Now, an example of processing in an interactive advertisement system 200will be described here. FIG. 11 is a flow chart showing an exemplaryoperation of a hand held terminal device 14 in the system 200.

In this example as well, data are configured by broadcast informationcontents D1 concerning a data broadcasting program (contents) andadvertisement information D2 concerning an interactive advertisement sothat the data are distributed from the broadcast station 9 to the user.The program used here includes moving pictures or comics such asphotographs or animation; still picture such as electronic programtable; and software (data) such as game, music, character information.An advertisement is organized so as to appear between these programs ina spot manner, and produced by software programs including image oraudio data.

In this example, the hand held terminal device 14 is set to the tunerdevice 24. In a data download wait state, the tuner device 24 enters astandby mode. The standby mode used here denotes a state in which asystem LSI such as microcomputer 70 or LCDC 88 of the hand held terminaldevice 14 is turned OFF excluding the interface function with respect tothe microcomputer 90 of the tuner device 24 and clock function.

In this interface function as well, unlike general data transfer, astartup command from the microcomputer 90 can be polled at a requiredminimum low rate. The tuner device 24 is supplied with power from apower circuit 80 to each unit to detect transfer request command. Inaddition, the hand held terminal device 14 is set to the tuner device24, and thus, a secondary battery 87 is charged by means of the powercharge control circuit 85 during this setting.

With this being presumed, in the tuner device 24, a transfer requestcommand distributed from the broadcast station 9 is detected during astandby mode at the step C1 in the flow chart shown in FIG. 11. In thecase where the transfer request command is detected by the tuner device24, the transfer request command for notifying the start of downloadingis transferred from the tuner device 24 to the hand held terminal device14. Thus, at the hand held terminal device 14, using a setup period, themicrocomputer 70 itself starts up the hand held terminal device 14 in areceiving mode at the step C2.

The receiving mode used here denotes an intermediate mode between astandby mode and a normal (general use) mode. The microcomputer 70enters a state in which, in addition to the standby function, a highspeed interface function with the tuner device 24 and an external memoryinterface function for transferring the acquired data to the datastorage 75 such as flash memory are further turned ON. Therefore, atthis time, power is supplied from the secondary battery 87 to the datastorage 75 and microcomputer 70 and the like.

Then, processing goes to the step C3 at which the reception indicatinglamp 37 indicating that data are being received is turned ON by means ofthe microcomputer 90 of the tuner device 24. The power charge indicatinglamp 36 is turned ON because the hand held terminal device 14 is set tothe tuner device 24. The hand held terminal device 14 waits for aprogram start command from the tuner device 24.

At the step C4, whether a program start command is described withrespect to a data following a setup period is detected by means of themicrocomputer 90. This program start command is a signal that notifiesthat transfer of all the programs downloaded one time is started. Thedata on all the programs is divided into a plurality of blocks asdescribed in FIG. 6 and FIG. 7. Therefore, when block start command isreceived (detected), processing goes to the step C5 at which whether ornot a block header is described in packets of the first (start) block isdetected.

In the case where this block header is detected, processing goes to thestep C6 at which packet-like data groups finely divided in blocks areplaced in the microcomputers 70 and 90, and packet transfer processingis executed while a handshake is taken. During this transfer processing,there is a case in which an external flash memory 43 as well as datastorage 75 is applied. Thus, this transfer processing also containsprocessing for transferring data to this flash memory 43 at any time.Namely, in the tuner device 24, when a data is received, the data isconveniently decoded to binary data by means of the data decodingcircuit 58.

As a decoded data file, the broadcast information contents D1 concerninga data broadcasting program and the advertisement information D2concerning an interactive advertisement are transferred to betemporarily stored in the flash memory 33 or the like. In this example,the decoded data file is transferred simultaneously to the flash memory33 and the storage 75 of the hand held terminal 14. Thus, even in thecase where the user fails to set the hand held terminal device 14 to thetuner device 24, the data file, can be re-transferred from the tunerdevice 24 to the hand held terminal device 14 after the file has beenreceived.

At the end of this packet, an end flag indicating the end of the blockis described. Thus, when the microcomputer 70 recognizes this fact,processing goes to the step C7 at which whether or not a program endcommand following the packet end flag is described is detected. In thecase where the program end flag is not detected, processing goes back tothe step C5 at which whether or not the next block header is describedis continuously detected.

In this way, data files are transferred one after another from the tunerdevice 24 to the data storage 75 or an external flash memory 43depending on the model of the hand held terminal device 14 until theprogram end command has been detected. When all the data are temporarilyrecorded in the flash memory 33 or data storage 75, external flashmemory 43, and the like according to a buffer memory in themicrocomputer 70, processing goes to the step C8 at which the receptionindicating lamp 37 of the tuner device 24 is turned OFF by means of themicrocomputer 90. A “receiving” indicator 47 of the hand held terminaldevice 14 is turned OFF by means of the microcomputer 70 that hasreceived the program end command.

Then, processing goes to the step C9 at which a “received” lamps blinkat the tuner device 24 and the hand held terminal device 14. The“received” lamp may be compatible with the reception indicating lamp 37or the “receiving” indicator 47. Processing goes to the step C10 atwhich the hand held terminal device 14 enters a standby mode.

Now, an exemplary operation of a hand held terminal device 14 in aninteractive advertisement system 200 will be described here. FIG. 12 isa flow chart showing an exemplary operation (main routine) of the handheld terminal device 14 in the interactive advertisement system 200.This example assumes a case in which the hand held terminal device 14 isremoved from the tuner device 24 shown in FIG. 10; and an interactiveadvertisement itself is seen or heard and operated in any times the userlikes by using advertisement information D2 stored in the data storage75 of this hand in held terminal device 14 or external flash memory 43.Here is exemplified a case in which the contents downloaded from thetransmission side include moving pictures or comics such as photographsor animation concerning a data broadcasting program; still pictures suchas electronic program table or broadcast information contents D1 such asgame, music, character information; and, for example, advertisementinformation D2 concerning vehicle sale.

With this being presumed, when the user turns ON the power source of thehand held terminal device 14 at the step E1 in the flow chart shown inFIG. 12, a system LSI consisting of the external interface 67,microcomputer 70, interface 86, and LCDC 88 enters a normal mode inwhich all the circuits are operable from the standby mode. Then, at thestep E2, a first spot advertisement concerning an interactiveadvertisement, the entire appearance of a vehicle in this example, isdisplayed directly.

Then, at the step E3, a menu screen is provided to be displayed on aliquid crystal displaying monitor 122. On this menu screen, some of databroadcast programs such as moving pictures such as photographs oranimation; still picture such: as comics or electronic program table; orgame, music, character information, are displayed. These databroadcasting programs are defined as applications A, B, C, D, . . . .The user is prompted to select any one of these applications A, B, C, D,. . . .

Then, at the step E4, the user is prompted such that the user can selectwhether to set a program reproduction mode or to set an interactiveadvertisement operating mode. In the case where a program reproductionmode is selected, processing goes to the step E5 at which the broadcastinformation contents D1 concerning the previously selected application Ais read out from the data storage 75 or external flash memory 43. Then,at the step E6, the video image information and audio informationaccording to the application A are reproduced.

In addition, in the case where the interactive advertisement operatingmode is selected at the step E4, processing goes to the step E7 at whichthe program information D21 and the video image element and audioinformation D22 concerning an interactive advertisement are read outfrom the data storage 75 or external flash memory 43. Then, at the stepE8, a video image according to an interactive advertisement isprocessed.

For example, by calling a subroutine shown in FIG. 13, a two-dimensionalor three-dimensional video image of a spot advertisement of a vehicle isdisplayed on a liquid crystal display monitor 122 with respect to aninteractive advertisement at the step F1. Then, processing goes to thestep F2 at which a menu screen is displayed on the liquid crystaldisplay monitor 122. On this menu screen, the menu concerning how tooperate an interactive advertisement or the like is displayed togetherwith operating procedures. Then, the user is prompted such that the usercan select whether to set an entire operation mode for video imaging andprocessing the entire vehicle or to set a partial operation mode forprocessing a partial video image of the vehicle at the step F3.

In the case where the entire operation mode is selected, for example,processing goes to the step F4 at which it is checked whether or not theentire video image of the vehicle is rotated. In the case where theentire video image is rotated, processing goes to the step F5 at whichthe rotation processing of that video image is done. In the case wherethe entire video image of the vehicle is not rotated, processing goes tothe step F6 at which it is checked, for example, whether or not theentire video image is expanded. In the case where the entire video imageis rotated, processing goes to the step F7 at which expansion processingof vide image information is done. In the case where the entire videoimage is not expanded, processing goes to the step F8 at which it ischecked whether or not the entire video image of the vehicle, forexample, is reduced. In the case where the entire video image isreduced, processing goes to the step F7 at which reduction processing ofvideo image information is done.

In the case where the entire video image of the vehicle is not reduced,processing goes to the step F10 at which it is checked whether or notthe color of the video image is changed, for example. In the case wherethe video image of the vehicle is changed in color, processing goes tothe step F11 at which the color change processing of the video image isdone. At this time, for example, a red colored vehicle is displayed tobe changed to a blue colored vehicle. When processing is ended at eachof the steps F5, F7, F9 and F11, processing goes back to the step F3 atwhich the user is prompted such that the user can select whether theentire operation mode is set or the partial operation mode is set.

Therefore, in the case where the partial operation mode is set at thestep F3, processing goes to the step F12 at which it is checked whetheror not the partial video image of the vehicle, for example, engine room,vehicle sheet, trunk room is rotated. In the case where these partialvideo images are rotated, processing goes to the step F13 at which therotation processing of video image information is done.

In the case where the partial video image of the vehicle is not rotated,processing goes to the step F14 at which it is checked whether thepartial video image is expanded, for example. In the case where thepartial video image is expanded, processing goes to the step F15 atwhich the expansion processing of video image information is done. Inthe case where the partial video image is not expanded, processing goesto the step F16 at which it is checked whether or not the partial videoimage is reduced, for example. In the case where the partial video imageis reduced, processing goes to the step F17 at which the reductionprocessing of the partial video image is done.

In the case where the partial video image of the vehicle is not reduced,processing goes to the step F18 at which it is checked whether or notthe partial video image is changed in color. In the case where thepartial video image is changed in color, processing goes back to thestep F19 at which the color change processing of the partial video imageis done. At this time, for example, black and silver colored sheets canbe changed to red sheets. When processing is ended at each of the stepsF13, F15, F17 and F19, processing goes back to the step F3 at which theuser is prompted to select whether to set the entire operation mode orto set the partial operation mode. In addition, in the case where theentire video image or the partial video image is not changed in color atthe step F10, F18, processing goes to the step F20 at which it is judgedwhether or not video image processing concerning an interactiveadvertisement is ended. This judgment is made by the user.

In the case where this video image processing is not ended, processinggoes back to the step F1 at which a program is continued. In the casewhere this video image processing is ended, it returns to the step E8 ofthe main routine shown in FIG. 12. Then, a video image is displayed, andan audio is output at the step E9. Then, processing goes to the step E10at which it is judged whether or not a program reproduction mode orinteractive advertisement operation mode and the like is ended. Thisjudgment is made by the user. In the case where the user sees and hearsapplications A and B, processing goes back to the step E2 at which aspot advertisement concerning an interactive advertisement is displayedagain.

In the case where these modes are ended, for example, processing goes tothe step E11 at which a liquid crystal display monitor 122 is set to aclock screen, and processing goes to the step E12 at which the powersource is turned OFF, thereby entering a standby mode. In the case wherethese modes are not ended, processing goes back to the step E2 at whicha spot advertisement concerning an interactive advertisement isdisplayed based on video image element and audio information D22 beforedisplaying a data broadcasting program. When the data broadcastingprogram is ended, a spot advertisement concerning an advertisement basedon these items of information D22 may be displayed.

As described above, in the interactive advertisement system 200according to the second embodiment of the present invention, unlike aconventional advertisement of television or radio broadcast, there isused advertisement information D2 temporarily stored in the data storage75 of the hand held terminal device 14 or an external flash memory 43.Thus, the interactive advertisement itself can be seed or heard andoperated any time the user likes.

In the present embodiment, there has been described a case in which aspot advertisement is displayed immediately after the power switch hasbeen turned ON and before ending applications A, B, C . . . , and goingto the menu screen. This advertisement may be inserted as anadvertisement providing frame into the applications A, B, C, . . . ,without being limited thereto. At this time, the spot advertisements areprovided so as to be incorporated individually in each of theapplications based on additional definition processing.

(4) Third Embodiment

FIG. 14 is a block diagram depicting an exemplary internal configurationand connection of a tuner device 24′ and a hand held terminal device 14used in an interactive advertisement system 300 that is a thirdembodiment according to the present invention.

In this example, a data received by the tuner device 24′ is directlytransferred to and stored in the data storage 75 in the hand heldterminal device 14 or a non-volatile storage device such as externalflash memory 43. Like elements in the second embodiment are designatedby like reference numerals and names, a description of which is omittedhere because these functions are similar to each other.

In this interactive advertisement system 300, unlike the secondembodiment, a non-volatile storage device is not provided in the tunerdevice 24′. In the case where a digital program broadcast and aninteractive advertisement are received from the broadcast station 9,they are always received in a state in which the hand held terminaldevice 14 is mounted on the tuner device 24′.

In an operation during reception, at the step C6 in the flow chart shownin FIG. 11, as described in the second embodiment, a data is directlytransferred to the hand held terminal device 14, and is subject towriting control of the microcomputer 70 in this hand held terminaldevice 14. Then, information concerning a data broadcasting program andan interactive advertisement is stored in the data storage 75 orexternal flash memory 43 and the like. The other operation is identicalto that in the second embodiment, a description of which is omittedhere.

Therefore, in the third embodiment, unlike the second embodiment, aflash memory 33 can be omitted from the tuner 24′, and the tuner device24′ can be reduced in price.

(5) Fourth Embodiment

FIG. 15 is an imaginary view showing an exemplary configuration of aninteractive advertisement system 400 that is a fourth embodimentaccording to the present invention. FIG. 16 is an imaginary view showingan exemplary format of a data in an advertisement specific channel.

This interactive advertisement system 400 is directed to a system, inwhich there is provided a hand held terminal device 401 with a tunerfunction as shown in FIG. 15, provided as an example of an informationprocessing apparatus, and advertisement information D2 concerning aninteractive advertisement is directly received from the broadcaststation 9 or the like through a rod antenna 41 so as to be stored in anon-volatile memory. Of course, broadcast information contents D1concerning a data broadcasting program may be downloaded.

In particular, there is shown a case in which advertisement informationD2 is distributed exclusively by using an advertisement specificchannel. The advertisement specific channel used here denotes a channelfor specially distributing only the advertisement information D2′concerning an advertisement. After receipt of the advertisementinformation D2, in the hand held terminal device 401, the user can readout and freely operate advertisement information D2 concerning aninteractive advertisement from a flash memory in unreal time any timeand any place the user likes.

Of course, advertisement information D2 includes video image element andaudio information D22 concerning an advertisement whose information canbe operated by the user; and program information 21 for processing theseitems of information D22. In this example, in the advertisement specificchannel, a plurality of advertisement information D2 are distributed. Inany of the items of advertisement information D2 downloaded from theadvertisement specific channel a priority to display it many times priorto another advertisement video image is set in advance.

In the advertisement specific channel, as shown in FIG. 16, all the dataconcerning a plurality of advertisements are broadcast one time, and theentire program is composed of a directory file and “n” commercials CM1to CMn. Namely, the directory file is placed at the beginning of theprogram, and concerning an advertisement contained in this program, thenumber (n) of contents of commercials (CM); “n” items of CM directoryinformation; CM counts, program size; on air codes that is a broadcastdate and time; program codes and the like are described in a datapacket.

Following this directory file, the commercial data CMi (i=1 to n) ofeach company is arranged sequentially. A file header is assigned to eachof the commercial data CMi. At the header, there are describedadvertisement information D2 such as advertisement codes such asadvertisement number; client codes for discriminating each advertiser99; file size indicating data length; a variety of flags for formatingand controlling data or the like. The CM data following these items ofinformation contains program information D21+video image element andaudio information D22, like game software. The contents of these itemsof information are as described with reference to FIG. 7.

Now, an exemplary internal configuration of a hand held terminal device401 with a tuner device will be described here. FIG. 17 is a blockdiagram depicting an exemplary internal configuration of the hand heldterminal device 401. Like elements in the third embodiment aredesignated by line reference numerals and name, a description of whichis omitted here because these functions are similar to that in thirdembodiment. In this example as well, in the case where a data isdistributed by an existing broadcast infrastructure, the datamultiplexed in a vertical blanking period of a data broadcast signaladopted by the broadcast infrastructure is received in the tuner 55, andthe data is provided so as to be downloaded on the flash memory 33.

The hand held terminal device 40 shown in FIG. 17 receives a group ofdata sent from the broadcast station 9, and causes image processing, andhas a system bus 79. To this system bus 79, there are connected areceiver 2, a control device 3, an operating unit including userinterface 4 and operation key 32, a display unit 6, and an audioprocessing unit 7 or the like. These receiver 2, processing unit 3 and7, operating unit and display unit 6 are driven by means of a secondarybattery 87.

The receiver 2 has a tuner 55, a communication modem 22, a channelselection switch 38, a channel selection circuit 56 and a flash memory33. This receiver receives a group of data by means of the tuner 55 orcommunication modem 22. Then, data such as broadcast informationcontents D1 after decoded, program information D21, or video imageelement and audio information D22 is stored in the flash memory 33.

This communication modem 22 is connected to Internet, telephone line, orsatellite line and the like so that a group of data received by thesecommunication lines are temporarily stored in the flash memory. Thecommunication modem 22 is used as a telephone function for transmittingand receiving an audio between a local station and a remote station. Inthe case where a simple hand held terminal device such as hand heldradio, having only a tuner function, is configured, the communicationmodem 22 may be omitted. In contrast, in the case where a hand heldterminal device having a telephone function is configured, it ismandatory that the communication modem 22 is provided.

The control device 3 in this example has a data decoding circuit 58 anda microcomputer 90 in which the video image element and audioinformation D22 is arbitrarily video imaged and processed based on theprogram information D21 stored in the flash memory 33 and operationinput D3 passed through the user interface 4 so as to reproduce theadvertisement video image and its audio. Of course, a data broadcastingprogram may be reproduced based on the broadcast information contentsD1.

The user interface 4 configuring the operating unit is connected to thissystem bus 79, and an operation key 32 is connected to this interface86. The operation key 32 is operated to control the data decodingcircuit 58 and the microcomputer 90.

Further, a liquid crystal display controller (LCDC) 88 configuring adisplay unit 6 is connected to the system bus 79, and a liquid crystaldisplay monitor 122 is connected to this controller 88 so as to displayan interactive advertisement video image operated by the operation key32. The audio processing unit 7 reproduces audio information accordingto an interactive advertisement, and performs amplification. Then, anaudio signal is output to the speaker 77. In the case of the audioprocessing unit with a hand held telephone function, it functions as atelephone receiver. A microphone 78 is connected to this audioprocessing unit 7. In the case of the audio processing unit with thehand held telephone function, it functions as a transmitter.

Now, an exemplary operation of a hand held terminal device 401 with itstuner function will be described here. FIG. 18 is a flow chart showingan example of data processing when the user sees and hears anadvertisement specific channel of the hand held terminal device 401.

The present embodiment assumes a case in which an advertisement specificchannel is selected by using an existing terrestrial broadcastinginfrastructure, and data concerning an interactive advertisement aredistributed from the broadcast station 9 to the hand held terminaldevice 401. There is exemplified a case in which at the transmissionside, as electronic information contents D0 concerning an advertisement,there is provided, for example, advertisement information D2 consistingof n commercial data CMi (i=1 to n) concerning vehicle sale, real estatesale, cosmetic sale, game software sale, or the like, and these dataD2=CM1+CM2+CM3 . . . CMn are transmitted by using a vertical blankingperiod of a TV broadcast signal. A priority is set to commercial dataCMi. The information concerning this priority can be described in thedirectory file or file header shown in FIG. 16, for example.

For example, the priority of commercial contents can be changed day byday. This change is made in order to improve an advertisement effect.This example assumes a case in which a priority is highly set tocommercial data CM8 of the broadcast date. The advertisement caused bycommercial data CM8 to which a high priority is set is referred to asprime CM hereinafter. This prime CM video image is defined as commercialcontents with their guaranteed exposure frequency, and of course, anadvertisement fee is high. This prime CM video image is always organizedto appear on a screen when power is turned ON and OFF in many CM programgroups CMi (i=1 to n) configured by being downloaded once.

In this case, the liquid crystal display monitor 122 is provided so asto first display a prime CM video image caused by commercial data CM8before displaying an advertisement video image (hereinafter, referred toas a second CM) caused by commercial data CM1 to CM7 and CM9 to CMn towhich no priority is set. In addition, the prime CM video image isdisplayed again after the display of the second CM video image has beenended.

When a prime CM is further displayed, a control program is executed suchthat the user can select arbitrary commercial data CMi from among theremaining commercial data CM1 to CM7 and CM9 to CMn. Namely, another CMgroup is executed by being selected on a menu screen so that the user Hjstarts up and operates a CM program like playing a mini game.

This example assumes a case in which a flash memory 43 stores in advanceadvertisement information D2=CM1+CM2+CM3 . . . CMn that consists of “n”commercial data CMi (i=1 to n) concerning vehicle sale, real estatesale, cosmetics sale, or game software sale or the like; and the handheld terminal device 401 enters a standby mode.

With this being presumed, when power is turned ON at the step G1 in theflow chart shown in FIG. 18, a standby mode is released, and the handheld terminal device 401 goes to a normal mode. Then, processing goes tothe step G2 at which a prime CM video image is displayed on the liquidcrystal display monitor 122. At this time, the program information D21according to the prime CM and the video image element and audioinformation D22 are read out from the flash memory 33 to themicrocomputer 90. Then, the display unit 6 or audio processing unit 7and the like is controlled by means of the microcomputer 90, whereby athree-dimensional, high resolution prime CM video image and its audioare reproduced.

At this time as well, as described in the second embodiment, theoperation key 32 is operated with respect to the prime CM, whereby thevideo image element and audio information D22 can be video imaged andprocessed based on the program information D21 as described in FIG. 13,and a two-dimensional or three-dimensional video image of an interactiveadvertisement can be played like playing a game.

Then, processing goes to the step G3 at which it is judged whether ornot the interactive advertisement operating mode is ended. This judgmentis entrusted to the user Hj. In the case where the interactiveadvertisement operating mode is not ended at the step G3, processinggoes to the step G4 at which a menu screen is displayed. The menuselection screen displays commercial data CMi (i=1 to 7, 9 to n)according to “n−1” second CMs such as vehicle sale, real estate sale,cosmetics sale or the like other than commercial data CM8 according tothe prime CM. Of course, at this time, the commercial data CM8 accordingto the prime CM may also be displayed.

Then, processing goes to the step G5 at which the microcomputer 90 waitsuntil the commercial data CMi according to the second CM has beenselected. Here, the user Hj selects an arbitrary second CM from among“n” second CMs. In the microcomputer 90, the commercial data CMiselected by the user Hj is read out from the flash memory 33.

Then, processing goes to the step G7 at which application processing ofcommercial data CMi is executed in the microcomputer 90. At this time aswell, the program information D21 according to the second CM and thevideo image element and audio information D22 are read out from theflash memory 33 to the microcomputer 90. Then, the display unit 6 oraudio processing unit 7 and the like is controlled by means of themicrocomputer 90, whereby a three-dimensional and high resolution secondCM video image and its audio is reproduced.

At this time, as described in the second embodiment, the operation key32 is operated with respect to the second CM, whereby the video imageelement and audio information D22 can be video imaged and processedbased on the program information D21 as described in FIG. 13, and atwo-dimensional or three-dimensional video image of an interactiveadvertisement can be played like playing a game.

Then, processing goes to the step G8 at which it is judged whether ornot the application processing is ended. This judgment is also made bythe user Hj. In the case where the application processing is ended,processing reverts to the step G2 at which a prime CM video image isdisplayed. In the case where the application processing is not ended,processing goes to the step G9 at which it is judged whether or not theapplication processing is repeatedly executed.

This judgment is also made by the user Hj. In the case where theapplication processing is repeatedly executed, processing reverts to thestep G7 at which application processing of commercial data CMi isrepeatedly executed. In the case where the application processing is notrepeatedly executed at the step G9, processing reverts to the step G4 atwhich a menu screen is displayed again. On this menu screen, there areprovided a variety of selection modes in which advertisement objects areclassified by categories such as software, commodity, company orrandomly (in a shuffling manner) or by user's characteristic dependencyand the like.

Application processing selected on the menu screen is executed. When theapplication processing is then ended at the step G8, processing revertsto the step G2 at which a prime CM video image is displayed again. Inthe case where the interactive advertisement operating mode is ended,processing goes to the step G10 in accordance with a command issued bythe user Hj to end the microcomputer 90 at the step G3. Then, the liquidcrystal display monitor 122 is set to a clock screen, the microcomputer90 detects power OFF information, and enters a standby mode.

In this way, in an interactive advertisement system 400 that is a fourthembodiment according to the present invention, the video image elementand audio information D22 concerning a plurality of advertisements whoseinformation can be operated by the user Hj and the program informationD21 for processing these items of information D22 are provided to bedistributed by using an advertisement specific channel.

Therefore, an advertisement video image can be operated at the user sidelike playing a game. Thus, in the future, electronic informationcontents D0 concerning an advertisement can be expected to naturallyspread in an increased number of users Hj who likes to play a game. Thismakes it possible to contribute to the introduction into a new demandfor advertisement industry.

Moreover, as in the second embodiment, unlike an advertisement of aconventional television or radio broadcast, the advertisementinformation D2 temporarily stored in the flash memory 33 of the handheld terminal device 401 is used, and the user can see or hear andoperate an interactive advertisement itself any time he or she likes.

In the fourth embodiment, the microcomputers 70 and 90 or interfaces 60and 70 can be integrated with each other in comparison with a case inwhich the hand held terminal device 14 and the tuner device 24 arecreated separately as in the second embodiment. Thus, in comparison witha case in which the hand held terminal device 14 and the tuner device 24are provided separately, thereby constructing an interactiveadvertisement system, the hand held terminal device 401 with its tunerfunction is provided, thereby making it possible to reduce the cost ofan information processing apparatus applied in the interactiveadvertisement system 400 and to simplify the system.

As has been described above, an electronic information contentdistribution processing system according to the present inventioncomprises an information processing apparatus for information processingelectronic information contents containing an advertisement, whereinelectronic information contents are received and stored; the electronicinformation contents are read out according to a user operation; theelectronic information contents are processed; and then, anadvertisement video image and audio information is output.

With this configuration, a concept of an advertisement caused, theadvertisement having been supplied one-sidedly, is reversed, and anelectronic advertisement medium for interactively performing anadvertisement can be constructed. Moreover, the user can operates anadvertisement information medium freely while feeling more enjoyablerelevant to an advertisement that has been just seen and heard. Thus,the user's interest is improved, and an advertiser can implement anadvertisement with its long advertisement life and high advertisementeffect.

An information distribution apparatus according to the present inventioncomprises a transmitter for, in the case where electronic informationcontents containing an advertisement are provided to the user,transmitting to the user's information processing apparatus a carryingsignal in which a group of data relevant to electronic informationcontents concerning an advertisement is constructed and inserted.

With this configuration, in the user's information processing apparatus,a group of data can be received in batch in a predetermined period oftime, and can be stored in a storage device or the like all together.Therefore, after receipt of electronic information contents, the usercan see and hear an advertisement video image or audio informationfreely processed with respect to an advertisement by the informationprocessing apparatus in unreal time (asynchronously).

In an information processing apparatus according to the presentinvention, in the case where electronic information contents containingan advertisement are information processed, the electronic informationcontents are received and stored, the electronic information contentsare read out according to the user operation, the electronic informationcontents are processed, and then, an audio advertisement video image andaudio information is output.

With this configuration, after receipt of electronic informationcontents, the user can see and hear freely the advertisement video imageand audio information obtained after arbitrarily information processedlike playing a game in unreal time. In this manner, a new game mediumfollowing arcade game, home use game machine, or hand held game machinecan be created. A new medium fusing the entertainment device andadvertisement can be created.

In an electronic information content distribution processing methodaccording to the present invention, in the case where electronicinformation contents containing an advertisement are provided to theuser, and the electronic information contents are information processedat the user side, the electronic information contents are distributed tothe user, and the thus distributed electronic information contents arereceived and stored. Then, electronic information contents are read outaccording to the user operation so as to reproduce an advertisementvideo image and audio information based on the electronic informationcontents.

With this configuration, the user can operate electronic informationcontents like playing a game. In the future, the electronic informationcontents concerning an advertisement can be expected to naturally spreadin an increased number of users who likes to play a game. Therefore, anadvertisement effect can be improved, making it possible to introduce ademand for a new advertisement industry. Instead of a commodity guidancethat has been supplied one-sidedly, the commodity is expressed with avariety of angles and colors, whereby the user can have an image as ifthe commodity were touched in hands. As a result, more detailedcommodity recognition can be imparted to the user, making it possible tobring a chance in which the user can be familiar with commodities on avideo image space.

In addition, a conventional advertisement production has been dominantin cumbersome and costly work such that talents or new products aredefined as main items, thereby causing performance or photographingactivities. According to the method of the present invention, workconcerning advertisement production can be digitally processed. Inaddition, a demand for digital creators engaged in animation, gamesoftware, or cinema production is increased, making it possible to causecreation of new employment and introduction into new industry. Further,exchange between a company that is an advertiser and a CM productioncreator is made actively, and the development and spread of computergraphic technology can be accelerated.

The present invention is applied very preferably to a new advertisementmedium such that the user operates advertisement contents distributedvia broadcast or communication interactively and feels more enjoyablelike playing a game.

1-11. (canceled)
 12. An information distribution apparatus fordistributing electronic information contents containing an advertisementto a user, said apparatus comprising: a data inserter for constructingthe electronic information contents concerning said advertisement in agroup of data, and inserting the contents into a carrying signal; and atransmitter for transmitting the carrying signal produced byconstructing and inserting the data into said data inserter to a user'sinformation processing apparatus.
 13. An information distributionapparatus as claimed in claim 12, wherein said data is distributed byusing existing broadcasting infrastructure or communicationinfrastructure.
 14. An information distribution apparatus as claimed inclaim 12, wherein said data is provided so as to be transmitted aftermultiplexed in a vertical blanking period of a television broadcastsignal adopted by said broadcasting infrastructure.
 15. An informationdistribution apparatus as claimed in claim 14, wherein said datainserter is provided so as to construct and insert the electronicinformation contents concerning said advertisement and broadcastinformation contents concerning an arbitrary program in a group of data.16. An information distribution apparatus as claimed in claim 12,wherein said electronic information contents are provided so as to bedistributed to a user through a advertisement specific channel assignedin advance.
 17. An information distribution apparatus as claimed inclaim 16, wherein video image element information and audio informationconcerning a plurality of advertisements whose information can beoperated; and program information for processing these items ofinformation are provided so as to be distributed by using saidadvertisement specific channel. 18-51. (canceled)
 52. An informationdistributing method, comprising the steps of: inserting electronicinformation contents containing video image element information andaudio information concerning an advertisement that can be operated; andprogram information for processing these items of information into acarrying signal; and transmitting the carrying signal having saidelectronic information contents inserted thereinto.
 53. An informationdistributing method as claimed in claim 52, wherein said electronicinformation contents are distributed by using an existing broadcastinginfrastructure or communication infrastructure.
 54. An informationdistributing method as claimed in claim 52, wherein said electronicinformation contents are transmitted to multiplied in a verticalblanking period of a television broadcast signal adopted by saidbroadcasting infrastructure.
 55. An information distributing method asclaimed in claim 54, wherein the step of inserting said electronicinformation contents is executed to insert the electronic informationcontents concerning said advertisement and broadcasting informationcontents concerning an arbitrary program to be constructed in a group ofdata.
 56. An information distributing method as claimed in claim 52,wherein said electronic information contents are provided to bedistributed to an user through an advertisement specific channel thathas been assigned in advance, and wherein the electronic informationcontents are provided to be distributed using said advertisementspecific channel. 57-73. (canceled)